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Abstract 

The  optimality  conditions  for  a  nonconvex  global  optimization  algorithm 
are  generalized  to  include   e  -  tolerances  on  the  computations.   The  class 
of  problems  for  which  the  new  conditions  imply  e  -  optimality  is  investigated 
and  shown  to  be  quite  broad. 
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Background 

Nonlinear  programming  problems  which  are  not  convex  programs  are  trouble- 
some because  they  may  possess  local  optimal  solutions  which  are  not  global 
optimal.   In   [1]   an  algorithm  is  developed  for  globally  optimizing  separable 
nonconvex  programs.   The  purpose  of  this  note  is  to  generalize  the  optimality 
test  of  this  algorithm  to  include   e  tolerances  and  thus  to  make  it  suitable 
for  computer  implementation  where  inexact  arithmetic  requires  the  use  of  such 
tolerances.   The  notation  in  this  paper  is  the  same  as  that  in   [1] ;   we  will 
briefly  summarize  the  algorithm  in  this  paper,  but  for  details  the  reader  is 
referred  to   [1]  . 
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Abstract  of  Algorithm 

We  consider  the  separable  nonlinear  programming  problem 


NLP   min  f(x)  «  I  f  (^  )  (l) 


j=l  J   J 


n 
xbject  to  g  (x)  =  £  g   (x  )  <;  0  i  ■  1,  ..., 
3-1  J  J 


a  £  x.  £  b.    j  =  1,  ...,n 
J    J    J 


The  global  optimization  algorithm  under  consideration  is  an  incorporation 
of  generalized  linear  programming  into  a  branch  and  bound  structure.   At  each 
stage  of  the  branch  and  bound  search,  NLP  is  approximated  by  inner  linearization 
resulting  in  an  approximating  restricted  master  linear  program  called  P^ 


whose  decision  variables   A.,   are  weights  for  convex  combinations  of  fixed 
grid  points  x 


X:   Mn  I[AJkf.(xJk)  (2) 


subject  to     11   XJkgiJ(xJk)  £    0     i  -  1 m 


I   A.k  =  1  j   =  1,    ...,   n 


X41    £   0    . 

Jk 

Solution  of  P,   yields  primal  variables   A  ,   dual  variables   it  e  R   ,  aeR   . 

and  objective  function  value   Z  .   The  dual  variables   tt   from  the  restricted 
master  are  then  used  to  form  single  variable  Lagrangian  subproblems 
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A  m 

min    LjUj.tt)  =  fj(x.)  -J^ViJ^  O! 


a.  ■£  x .  £  b. 

J    J    J 


with  (global)  solutions  x. 

J 


The  P.   primal  solution  also  gives  an  approximate  solution  x*  to  NLP 


computed  from 


xV£VJk      J  -i.....»  co 


An  optimality  test  involving  x*,  x,  tt,  a,  Z  and  the  various  functions  in 
NLP  results  in  one  of  the  following 

i)   x*   is  globally  optimal  for  NLP 
ii)   a  new  grid  point  x.    for  the  restricted  master  P   is  created 

iii)   a  branch  in  the  branch  and  bound  algorithm  is  performed  by  creating 

two  restricted  master  problems,  one  with  x.  <   x*  and 

J    J 

the  other  with  x.  ^  x*  , 
J    J 

and  the  algorithm  continues.   For  further  details  refer  to   [1]  . 

This  paper  extends  the  theorem  which  validates  the  above  mentioned  optimality 
test. 
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Exact  Optimal ity  Theorem 

The  following  theorem  is  proved  in   [1] 


Let  C  =  {xla.  £  x.  £  b . } 
J    J    J 


Theorem  1  Let   A  be  primal  optimal  and   (tt.cO   dual  optimal  for  P, 

A  with 

objective  function  value  Z  .   Let  x*  have  components  x*  =  Tx.-x.. 

J    £  Jk  jk  . 

If  a)   x  globally  solves 

A  V 
min  L  (x,  tt)  =  L   L  (x  ,  tt),  (5) 

J 

xeC 

b)  f(x*)  £  Z  , 

c)  g.(x*)  £0   Vi  =  1 m  , 


and 


d)   L(x,  tt)  ^  la.    , 


then  x*   solves  NLP  (globally) 

Proof  See   [1]  , 

To  make  such  a  theorem  useful  in  the  context  of  a  computer  program  we  must 
realize  that  computer  arithmetic  is  not  exact,  and  consequently  even  if  the 
conditions  of  the  theorem  are  met ,  they  may  appear  to  be  only  approximately 
met  in  the  computer.   Furthermore,  in  solving  the  Lagrangian  subproblems   (5) 
the  computer  will  generally  be  unable  to  obtain  the  exact  solution,  so  again 
we  must  introduce   e  tolerances. 

The  chief  goal  cf  this  paper  is  to  prove  a  theorem  like  Theorem  1  where 

each  of  a,  b,  c,  d  has  a  tolerance  included. 
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e  -  Optimality 

Consider  the  optimal  objective  function  value  of  NLP  (l)   as  a  function 
of  a  general  right  hand  side  vector  deR   and  define  the  extremal  function 


finf   (d)  =  min  {f(x)|gi(x)  €.    d..  ,  i  =  1,  .  .  .  ,  m; 


a.  £  x.  <  b.} 
3    J    J 


Definition 


f.  „..   (d)   is  right  -  continuous  at   d  =  d  iff  Ve  >  0  ,  36  >  0 


such  that   d  •£  d  <;  d  +  6  implies  f.  _   (d)  +  e  ^  f.    (d)  .    (note  6  eR  ) 

inf  mf 


Definition   We  say  that  NLP  is  stable   iff  f.  _,  (d)   is  right  continuous 
mf 

at   d  =  0  . 


Lemma  1  If     tt  ^    0     then     min  L(x,   tt  )  €.    f.        '    (0) 
mf 

xeC 

Proof    Standard  result  from  nonlinear  duality. 

The  main  result  is  the  following  theorem. 

Suppose  as  in  Theorem  1  that   X   is  primal  optimal  and   (tt  ,a)   is  dual  optimal 
for  the  restricted  master  linear  program  P,   with  optimal  objective  function 
value  Z  .   Let   x*  have  components  x*  =  M.,*., 


Theorem  2 


that  if 


Suppose  NLP  (l)   is  stable.   Given  any  e  >  0  ,   36  ->  0   such 

(6) 


a)  L(x,tt)  <   min  L(x,tt)  +  e/U 

xeC 

b)  f(x*)  £  Z  +  e/k 


(7) 


c)  g(x*)  <;  6 


n 


d)  L(x,tt)  +  e/k  >   la 
j=lJ 


(8) 
(9) 
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then  x*   is  globally   e  -  optimal  for  NLP  . 


Proof   By  stability  we  can  select   6  >  0   such  that   if  g(x*)  <    6  then 

f(x*)  +  e/U  £  f.  „   (6)  +  e/U  *  f.  .„      (0)  =  min  {f(x)|x  feasible}.  (10) 
lnf  inf  for  NLP 


Now  at  optimal ity  for  P^   we  have  equal  primal  and  dual  objective  function 
values. 


]  £*  VV  - z  ■  &  .  (id 


and  dual  feasibility  for  P.   implies 


7T  5  0  (12) 


Thus  Lemma  1  implies 


min  L(x,u)  5  min  {f(x)|x  feasible  for  NLP}  .  (13) 

xeC 


Using   (11),  (9),  (6),  (13),  (10)   and   (T)   in  that  order  gives 


Z  =  £a.  5  L(x,tt)  +  e/U  5  min  L(x,tt)  +  e/U  +  e/U  5  min  {f(x)|x  feasible  for  NLP}  +  z/2 
3  xeC 


5  f(x*)  +  e/U  +  e/2  5  Z  + 


e  . 


Thus  all  of  the  quantities  in  the  above  inequalities  are  within  e  of  each 
other,  and  consequently  f(x*)  is  within  e  of  being  (global)  optimal  for 
the  original  problem  NLP. 
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Stability  Conditions 

Examination  of  the  proof  of  Theorem  2  shows  that  the  stability  of  NLP 
is  crucial  to  the  demonstration  of  e  -  optimality.   It  is  therefore  vital  to 
determine  when  we  can  expect  the  extremal  function   f.     to  be  right  continuous 
at   0  .   Some  results  on  the  problem  are  presented  in   [2]   and  the  relevant 
ones  will  be  repeated  here  without  proof. 


Let  S_  =  {xlg(x)  Sd,  xeC}  ,   then  S   is  the  feasible  region  for  NLP  . 
d  o 

Note  that  S   is  a  compact  set  since  C   is  bounded.   Assume  g.   is  continuous 

V.  =  1,  ... ,  m   . 
i 


Definition   Suppose  S   is  compact.   The  point  to  set  mapping  S:d  -*■   S 

is  said  to  be  upper  semi continuous  (u.  s.  c.)  at   d  =  0  iff  Ve  >  0  36  >  0 

such  that   Idl  .<  5  =»  S,  c  N  (S  )  . 
11        d    e  o 

In  words,  a  small  increase  in  the  right  hand  side  of  NLP  cannot  lead  to  a 
discontinuous  expansion  of  the  feasible  region. 


Theorem  3   The  mapping  S   is  u.s.c.   at  0   iff  3d  >  0   such  that   S~   is 
compact . 


Note  that   S~   is  compact  for  any  d  in  our  NLP  since  C   is  bounded,  thus  for 
any  increase  in  the  RHS    of  the  g  constraints  ,  the  feasible  region 

changes  continuously.   It  should  also  be  noted  that  for  decreases  in  the  RHS 

the  problem  is  much  more  complex  (see  [2])  but  fortunately  our  e  optimality 
theorem  does  not  require  this  case. 
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Theorem  h        If  f(x)   is  a  lower  semicontinuous  function  and  S   is  u.s.c. 

at   0  ,   then   f .  _   is  right  continuous  at   0. 
'         inf 


These  results   imply  that  xhe   e  -  optimality  theorem  is  valid  for  a  vide 
variety  of  non-convex  programs.   In  particular   f,  g  continuous  over  C   implies 
that  NLP   is  stable  at   0  . 
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